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APPARATUS AND METHOD FOR As a result of the dramatic increases in the both com- 

COMMUNICATING BETWEEN AN plexity of computer programs and the amount of information 

INTELLIGENT AGENT AND CLIENT available to users, substantial interest has developed in the 

COMPUTER PROCESS USING DISGUISED area of intelligent agent computer programs, also referred to 

MESSAGES 5 as intelligent agents or simply agents, that operate much like 

software-implemented "assistants" to automate and simplify 

CROSS-REFERENCE TO RELATED certain tasks in a way that hides their complexity from the 

APPLICATIONS user. With agents, a user may be able to perform tasks 

... , - * i, • * y p j-% without having to know specific sequences of commands. 

Tliis applica ion is related to the following U.S. Patent w similafl a ^ be j£ {Q ^ information without 

Applications a of which were filed on even date herewith hayi knQW Qr whefe search for 

by Bigus et al: U.S. application Ser. No. 08/821,935 entitled information 

"INTELLIGENT AGENT WITH NEGOTIATION CAPA- f * , . 

BILITY AND METHOD OF NEGOTIATION Intelligent agents are characterized by the concept of 

THEREWITH", U.S. application Ser. No. 08/826,107 1fi delegation, where a user, or client, entrusts the agents to 

entitled "APPARATUS AND METHOD FOR OPTIMIZ- 15 handle tasks ^ at least a certam de g ree of auton °my. 

ING THE PERFORMANCE OF COMPUTER TASKS Intelligent agents operate with varying degrees of con- 

USING MULTIPLE INTELLIGENT AGENTS HAVING stramts de P endm g u P°n the amount of autonomy that is 

VARIED DEGREES OF DOMAIN KNOWLEDGE" and delegated to them by the user. 

U.S. application Ser. No. 08/822,993 entitled "APPARA- Intelligent agents may also have differing capabilities in 

TUS AND METHOD FOR OPTIMIZING THE PERFOR- terms of intelligence, mobility, agency, and user interface. 

MANCE OF COMPUTER TASKS USING INTELLIGENT Intelligence is generally the amount of reasoning and deci- 

AGENT WITH MULTIPLE PROGRAM MODULES HAV- sion making that an agent possesses. This intelligence can be 

ING VARIED DEGREES OF DOMAIN KNOWLEDGE" . as simple as following a predefined set of rules, or as 

The disclosures of all of these applications are hereby 5 complex as learning and adapting based upon a user's 

incorporated by reference herein. objectives and the agent's available resources. 

Mobility is the ability to be passed through a network and 

FIELD OF THE INVENTION execute on different computer systems. That is, some agents 

The invention is generally related to intelligent agent ma ? be k desi ^/° *»y on one computer system and may 

. * ui * J i *u never be passed to different machines, whde other agents 

computer programs executable on computer systems and the 30 . r .„ . 7 A . , f , 

ri a • i — 1- a m ay be mobile in the sense that they are designed to be 

like, and in particular, the decision logic and communica- ac lm c • * i 

, r . \, , & passed from computer to computer while performing tasks at 

tions mechanisms used by such programs. 1 XT ■ . _c ^ ,_ 

y v B different stops along the way. User interface defines how an 

BACKGROUND OF THE INVENTION a S ent interacts with a user, if at all. 

35 Agents have a number of uses in a wide variety of 

Since the advent of the first electronic computers in the applications, including systems and network management, 

1940's, computers have continued to handle a greater vari- mobile access and management, information access and 

ety of increasingly complex tasks. Advances in semicon- management, collaboration, messaging, workflow and 

ductors and other hardware components have evolved to the administrative management, and adaptive user interfaces, 

point that current low-end desktop computers can now Another important use for agents is in electronic commerce, 

handle tasks that once required roomfuls of computers. whcre aa age[lt may be configured to seek out other parties 

Computer programs, which are essentially the sets of such as other users, computer systems and agents, conduct 
instructions that control the operation of a computer to negotiations on behalf of their client, and enter into corn- 
perform tasks, have also grown increasingly complex and mercial transactions. 

powerful. While early computer programs were limited to 45 j us t as human agents have a certain amount of autonomy, 

performing only basic mathematical calculations, current intelligent agents similarly have a set of constraints on what 

computer programs handle complex tasks such as voice and they are authorized and not authorized to do. For example, 

image recognition, predictive analysis and forecasting, mul- a ^n^g agerjt f or electronic commerce applications may be 

timedia presentation, and other tasks that are too numerous constrained by a minimum acceptable price. However, a 

to mention. 50 g 00C ] selling agent, whether electronic or human, would 

However, one common characteristic of many computer never initially give its lowest acceptable price, as this would 

programs is that the programs are typically limited to minimize profit margins. Furthermore, giving the lowest 

performing tasks in response to specific commands issued price may not even assure sales because a buyer may infer 

by an operator or user. A user therefore must often know the that the price is not competitive because the agent is unwill- 

specific controls, commands, etc. required to perform spe- 55 ing to lower the price from the original offer. Therefore, an 

cific tasks. As computer programs become more complex agent typically starts negotiations with some margin from its 

and feature rich, users are called upon to learn and under- worst case acceptable price, then works toward a mutually 

stand more and more about the programs to take advantage acceptable price with the other party, 

of the improved functionality. Any negotiation plans, techniques, strategies or other 

In addition to being more powerful, computers have also 60 confidential information used by an intelligent agent to 

become more interconnected through private networks such operate within its constraints, however, often should be 

as local area networks and wide area networks, and through hidden from other parties. Otherwise, the agent is placed at 

public networks such as the Internet. This enables computers a competitive disadvantage. Given that many agents may be 

and their users to interact and share information with one dispatched to unsecured environments, an assumption must 

another on a global scale. However, the amount of infor- 65 be made that other parties may be able to scan or reverse 

mation is increasing at an exponential rate, which makes it engineer an agent to leam its negotiation strategy or other 

increasingly difficult for users to find specific information. constraints. It must also be assumed that other parties may 
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be able to decode messages sent between an agent and its hereto and forming a further part hereof. However, for a 

client to obtain the greatest advantage in negotiation. The better understanding of the invention, and of the advantages 

validity of such assumptions stems from the fact that these and objectives attained through its use, reference should be 

techniques are conceptually similar to many of the tech- ma dc to the Drawing, and to the accompanying descriptive 

niques used by some salespeople to obtain the best price s matle r, in which there is described illustrated embodiments 

P ossible - of the invention. 

For example, if a message to an agent from its client 

indicates that the agent should offer $100, but is authorized BRIEF DESCRIPTION OF THE DRAWING 
to go as low as $90, another party that intercepts this 

message immediately knows that a transaction may be 10 FIG. 1 is a flowchart illustrating the operation of an 

completed at the lower price. Also, even if the message is not intelligent agent consistent with the principles of the 

intercepted, if the agent has stored the $90 price as its lowest invention, utilizing procedural decision making and message 

authorized offer, reverse compilation or scanning of the disguising. 

agent by another party may lead to similar results. FIG. 2 is a flowchart illustrating the operation of another 

Efforts have been made to encrypt messages between an 15 intelligent agent consistent with the principles of the 

agent and its client. However, most conventional encryption invention, utilizing neural network-implemented decision 

methods rely on private "keys" for the agent and the client. making and procedural message disguising. 

Encryption presupposes that both the sender and receiver are FIG. 3 is a flowchart illustrating the operation of another 

in secured environments— only the transmission path intelligent agent consistent with the principles of the 

between them is unsecured. However, as an agent may be 2 o invention, utilizing neural network-implemented decision 

resident on and executing in an unsecured environment, the making and message disguising. 

agent may be reverse compiled or scanned to obtain its FIG. 4 is a block diagram of a networked computer 

private key and thereby break the encryption. Consequently, m environment for use with the ii lustra ted embodi- 

conventional encryption techniques do not adequately pro- mentg of the ^^0^ 

tect the confidential communications of agents or other 0 c ^.^ _ . L1 . ,. - . t , 

4 . . ■ , rlu. 5 is a block diagram of. the networked computer 

computer programs executing in unsecured environments. , c _ A t * . . t * Y . 

„ j . . . . system of FIG. 4, illustrating the interaction between mtel- 

Thererore, a significant need exists in the art for a manner iicr en t agents therein 

of protecting the confidential information of an intelligent * .",,«. 

agent computer program. FIG ' 6 15 anolher block dia & ram of thc networked com- 
puter system of FIG. 4, illustrating in greater detail the 

SUMMARY OF THE INVENTION 30 primary components in the client and remote computer 

The invention addresses these and other problems asso- systems, 

ciated with the prior art in providing a manner of commu- FIG. 7 is a flowchart illustrating the interaction between 

nication between an agent and its client where a selector is the agent manager, mobile agent and negotiating agent 

used in the generation and interpretation of messages to 35 (other party) of FIG. 5. 

effectively disguise confidential information transmitted in FIGS Ha md Hb are 51ock diagrams illustrating the 

the messages from third parties. In contrast to encryption primary components in one embodiment of the intelligent 

techniques which attempt to scramble the contents of a agent of FIG. 5. 

message, the selector controls how a given message, which CTO n . a , ^ .« , t . a c 

« ♦ u. 1 1 j . . . . r\ * uJ a FIG. 9 is a flowchart illustrating the program flow of a 

need not be scrambled, is interpreted by transmitting and A . 4 . . . . t . c • . • ■ .u i 

... ' r 7 & 40 network trammg routme for use m traimng the neural 

receiving par es. network in the intelligent agent of FIGS. 8a and 86. 
A selector for use with the various embodiments of the 

invention may be a predetermined parameter known to both DETAILED DESCRIPTION OF THE 

the agent and client, or may be transmitted between the ILLUSTRATED EMBODIMENTS 

agent and client in the same message as the confidential 45 

information or in a separate message. Moreover, the selector The embodiments of the invention incorporate various 

may be maintained as a distinct parameter that is known by manners of disguising confidential information in an intel- 

or transmitted between the parlies, or may be derived from ligent agent from third parties. 

an existing parameter having another use or purpose. Intelligent agents are computer programs which have 

The selector may be used in a number of manners to 50 been delegated a degree of autonomy but which are limited 

disguise confidential information. For example, the selector to operating within constraints defined by their client (which 

may be used to select one of a plurality of messages to may be, for example, another agent; a computer program, 

transmit, to select one of a plurality of alternate meanings for application or system; or an individual interacting with the 

a particular message, to select where the confidential infor- agent through a computer — hereinafter a client computer 

mation is in a plurality of transmitted messages, and to 55 process). A subset of such agents which are capable of being 

indicate which of a plurality of messages to omit from a passed between and operating in different applications or 

transmission, among others. computer systems are referred to as mobile agents. 

Moreover, in certain embodiments of the invention, the In general, an agent has the ability to sense, recognize and 

decision logic of an agent may be disguised from third act. These functions are typically embodied in a number of 

parties through the use of neural networks to implement part 60 components, including an engine, a knowledge component, 

or all of the decision logic. Neural networks, which rely on an adapters component, a library, and a view component, 

interconnected nodes having variable weights to encode Generally, the engine controls the overall operation of an 

logic, are not readily reverse compiled or scanned, thus agent and functions as the "brains" of the agent, and the 

offering significant security advantages for an agent that is knowledge component stores information that is represen- 

operating in an unsecured environment. 6 5 tative of the acquired knowledge of the agent. The adapters 

These and other advantages and features, which charac- component handles interaction between an agent and exter- 

terize the invention, are set forth in the claims annexed nal objects, thereby functioning as the mechanism through 
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Example Transform Table 










Selector 




Information to Convey 


1 


2 


3 


will go lower, no risk 
may go lower, some risk 
doubtful will go lower, high risk 


Msg A 
MsgB 
MsgC 


MsgB 
Msg C 
Msg A 


MsgC 
Msg A 
MsgB 
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which the agent "senses" and interacts with its environment. information, although it should be appreciated that messages 

A library persistently stores the information utilized by the need not have more than one meaning, 

knowledge component, and the view component provides For example, Table I below shows a transform table 

the human interface, if any, for an agent, e.g., for supplying illustrating how three messages "A", "B" and "C" from a 

instructions to the agent. 5 message set may be used by an agent to convey three pieces 

An agent may receive, transmit, store and otherwise of confidential information (here, whether to accept or 

utilize confidential information such as data, unique decision counteroffer) depending upon the value of a selector: 
logic or strategies, desired goals, etc. to which a client may 

wish to limit access by third parties. For example, in TABLE I 

electronic commerce applications, an agent may wish to 10 
prevent parties with which it is negotiating from knowing 
certain information such as its negotiation strategy and 
authorized offer limits. This confidential information may be 
subject to scrutiny, however, if another party is capable of 

intercepting messages between the agent and its client, or if 15 
another party is capable of reverse compiling or otherwise 
scanning the program code of the agent. 

To address the former problem, the embodiments of the 

invention utilize a unique signaling methodology which 0ne advantage of this configuration is that the messages, 

relies on a selector that is ultimately known by both the 20 beyond disguising their contents or intended meaning, may 

agent and agent manager to generate and interpret messages cause another party to mistakenly believe a particular mes- 

which disguise the confidential information contained sage has a different meaning For example, if a buying agent 

therein. As will become apparent below, in contrast to sends , a messa 8 e t0 thc seekm & authorization to 

encryption techniques, the messages need not be modified, complete a transaction at the last offered price, but the 

encrypted or scrambled, as the selector is used primarily to 25 messa S e 15 interpreted by the selling party to mean that the 

interpret the meaning of the messages. a 6 ent wants to terminate negotiations, the selling party may 

^ , xl _ . reduce its price to try to complete the transaction. 

One difference between the use of a selector and encryp- ^ be ^ M M of a ^ 

tion techniques is that, m the ca* of a selector, a third party Qf ffl ^ desired amBaeBm info , mauon . 

may mistakenly believe a message has a different meaning 3Q Fm me A( B aod c from Table r abo ve could 

man its true meaning and may inadvertently act to the ^ be transmitted tocether, within a single transmission, with 

advantage of the client. Another advantage over encryption ^ selector ^ f » s shouW be 

is that the fact that a message is disguised is not readily considered similarl 7 a Mot be used * ^ which 

apparent, whereby the message typically -does not stand out of u rf ^ to ^ ^ a transmission . For 

relative to other messages It should be appreciated, 35 exan jpi e f ot a ggj 0 f messages A-C, transmit messages A 

however, that encryption techniques may be used in com- j rT u * * o < _* • • c • c *- 

, . . . , - . ... . , . and B but not C to convey a certain piece or information, 

bination with message disguising in certain embodiments of A i * u j * • i * i * 

At _ A . ... & & A . & , ,. . , ,. A selector may be a predetermined parameter known to 

the invention, with encryption used on disguised or undis- , * j r It? 1 *u i * u 

. , ' ¥ l j- * * t .i both the agent and client. For example, the selector may be 

guised messages. In one embodiment, for example, the A r- A *> t , , , , e . /■ 

? - b . , . A 9 . « modified after a predetermined number or communications 

information to be transmitted may be sent in disguised AQ or cycles ( e . g ., every three transmissions), 

messages with encrypted decoy messages also sent to draw A^iector m ay also be transmitted between the agent and 

attention away from the disguised messages. clien( ^ the same message as ^ confidential information , 

For example, FIG. 1 illustrates a program flow for an in a separate message within the same transmission, or in a 

intelligent agent 160 consistent with the invention. Agent se parate transmission altogether. For example, an agent 

160 operates by receiving input at block 162 and making a 45 manager may transmit an "increment selector" message to 

decision based upon the input at block 164. Block 164 ^ agent M that lhe nexl seleclor value in a M of possible 

outputs confidential information therefrom, which is dis- valucs ^ uscd> or aQ agent may prccede a mcssage with a 

guised in a message in block 166 based upon a selector 167. sep arate message indicating from which message set the 

The message is then sent in block 168 and control returns to managcr sho uld interpret the message (e.g., for Table I, 

block 162. 50 messa ge D indicates selector 1, message E indicates selector 

The use of a selector may be analogized to the hand 2, message F indicates selector 3). 

signals used by baseball players and coaches to communi- Multiple selectors may be interleaved with the confiden- 

cate during a baseball game (e.g., pulling on the ear, tial information in a message, e.g., sets of bits. For example, 

touching the nose, etc.). The signals or messages are visible a 32 bit message could contain 3 8-bit pieces of data, along 

to all, yet are difficult, if not impossible, to interpret because 55 with 8-bits of selector information parsed into 4 2-bit 

they are known only to the team using them, and because selectors that are disposed at the boundaries of the 8-bit 

their meanings are often changed. Certain signals may have pieces of data. A look-up table may be utilized to assist in the 

different meanings in different situations, which may con- interleaving of selector information into a message. In 

fuse the other team or cause the other team to mistakenly addition, other extraneous information that is ignored during 

believe a particular signal has another meaning. 60 interpretation may be included in a message, e.g., a few high 

The seleclor may be used in a number of manners to order bits may be added to a value, but may be ignored 

disguise confidential information. For example, a selector during interpretation. Furthermore, information may be split 

may be used to select one of a plurality of messages to between multiple messages or transmissions, with a selector 

transmit to convey a particular piece of confidential infor- controlling from where the information may be retrieved and 

mation. Moreover, one or more of the messages may have a 65 how it is to be interpreted. 

plurality of alternate meanings. This may permit one set of Moreover, the selector may be maintained as a distinct 

messages to represent a plurality of pieces of confidential parameter that is known by or transmitted between the 
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parties, or may be derived from an existing parameter having 
another use or purpose. For example, a selector may be 
derived from the time stamp on a message (e.g., the last 
digit, or the remainder when the sum of the digits is divided 
by three, etc.), or from a checksum value for the message. 
Other seemingly innocuous information, whether known to 
both the client and agent, or transmitted therebetween, may 
be used to generate a "pseudo-random" selector. 

Agent 160 of FIG. 1 illustrates a procedural process of 
decision making and message disguising, whereby a series 
of steps are executed sequentially by a computer program to 
handle the functions in blocks 164 and 166. However, 
procedural logic may be subject to reverse compilation and 
scanning by third parties. One alternative to agent 160 is 
illustrated in FIG. 2, where an agent 170 substitutes a neural 
network 172 for procedural decision making. Message dis- 
guising is still handled through a procedural block 176 
which receives a selector 177 and outputs a disguised 
message sent via block 178. 

The implementation and training of neural networks is 
well known in the art. The primary advantage of neural 
network-implemented decision making is that it is extremely 
difficult to determine the logic trained into a neural network 
since the logic is based upon weights, and not on a proce- 
dural process. A neural network utilizes a set of processing 
elements or nodes that are interconnected in a network, with 
each node typically outputting a weighted sum of its inputs. 
The weight to apply to each input to a node is "learned" over 
time by a neural network by training the network with 
sample, or training, data. 

However, while agent 170 is significantly more resistant 
to scrutiny by third parties, the agent may still be subject to 
some scrutiny since a procedural process is used in block 
176 to generate disguised messages from an undisguised 
output generated by the neural network. It must be assumed 
that any undisguised data stored in an agent may be subject 
to reverse compilation and scanning when the agent is in an 
unsecured environment. 

FIG. 3 illustrates an agent 180 which extends the use of 
a neural network to both decision making and message 
disguising. A neural network 182 receives a plurality of 
inputs, including also one or more selectors (e.g., selectors 
184 and 186) from which a disguised message is generated. 
Also, neural network 182 only outputs one or more dis- 
guised outputs (e.g., disguised output 1 and disguised output 
2). Consequently, at no point is any undisguised data stored 
in agent 180. 

Training of neural network 182 requires additional train- 
ing records or examples to handle message disguising in 
view of the additional input of a selector to the network. For 
example, to train a neural network without disguised 
messages, the standard training data would include N train- 
ing records, as shown in Table II below: 

TABLE II 







Standard Training Records 
Inputs 


Outputs 


il.l 


il.2 


il.3 


ol 


i2.1 


i2.2 


i2.3 


o2 


ki 


iN.2 


iN.3 


oN 



general one group of training records are required for each 
possible value of the selector, which may be accomplished 
merely by reusing the original pure training information, 
duplicated for each value of the selector (e.g. 1 - K), and 
with the messages (e.g., messages A, B, . . . M) properly 
arranged for each value, as shown in Table III below: 

TABLE III 

Example Training Records - One Selector 

Selector Outputs 



20 



30 



il.l 


il.2 


il.3 


1 


msg 1A 


i2.1 


i2.2 


i2.3 


1 


msg l.B 


iN.l 


iN.2 


iN.3 


1 


msg l.M 


il.l 


il.2 


il.3 


2 


msg 2A 


i2.1 


i2.2 


i2.3 


2 


msg 2.B 


iN.l 


iN.2 


iN.3 


2 


msg 2.M 


il.l 


il.2 


il.3 


3 


msg 3A 


i2.1 


i2.2 


i23 


3 


msg 3.B 


iN.l 


iN.2 


iN.3 


3 


msg 3.M 


il.l 


il.2 


il.3 


K 


msg K-A 


i2.1 


i2.2 


i2.3 


K 


msg K.B 


iN.l 


iN.2 


iN.3 


K 


msg K.M 



To output more than one disguised message at a time 
requires no additional training besides that required by the 
number of inputs. For example, as shown in Table IV, to 
generate three output messages, the following training data 
may be used: 



TABLE IV 



40 



45 



50 



Example Training Records - Multiple Messages 



Inputs 



Selector Outputs 



55 



60 



il.l 


Ll.2 


il.3 ... 


1 


msg 1.A1 msg 1.A2 msg 1.A3 


i2.1 


i2.2 


i2.3 ... 


1 


msg 1.B1 msg 1.B2 msg 1.B3 


iN.l 


iN.2 


iN.3 ... 


1 


msg 1.M1 msg 1.M2 msg 1.M3 


il.l 


il.2 


il.3 ... 


2 


msg 2.A1 msg 2.A2 msg 2.A3 


i2.1 


i2.2 


12.3 ... 


2 


msg 2.B1 msg 2.B2 msg 2.B3 


iN.l 


iN.2 


iN.3 ... 


2 


msg 2. Ml msg 2.M2 msg 2.M3 


il.l 


il.2 


il.3 ... 


3 


msg 3.A1 msg 3.A2 msg 3.A3 


i2.1 


L2.2 


i2.3 ... 


3 


msg 3.B1 msg 3.B2 msg 3.B3 


iN.l 


iN.2 


iN.3 ... 


3 


msg 3.M1 msg 3.M2 msg 3.M3 


il.l 


il.2 


il.3 ... 


K 


msg K.A1 msg K.A2 msg K.A3 


i2.1 


i2.2 


i2.3 ... 


K 


msg K.B1 msg K.B2 msg K.B3 


iN.l 


iN.2 


iN.3 ... 


K 


msg KM1 msg K.M2 rnsg K.M3 



In addition, to generate disguised messages based upon 
more than one selector, a set of training data is required for 
However, to also train the neural network to disguise 65 each combination of selector values. For example, as shown 
messages, additional training records are required given that in Table V, for a set of three selectors, and two outputs, the 
an output may be represented by more than one message. In following training data may be used: 
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TABLE V 



Example Training Records - Multiple Selectors 





Inputs 


Selector 


Outputs 


il.l 


il.2 


il.3 


1.1.1 


rnsg 1.1.1.A1 msg 1.1.1.A2 


i2.1 


i2.2 


i2.3 ... 


1.1.1 


msg 1.1.1.B1 msg 1.1.1.B2 


iN.l 


iN.2 


iN.3 ... 


1.1.1 


msg 1.1.1.M1 msg 1.1.1.M2 


il.l 


il.2 


il.3 ... 


1.1.2 


msg 1.1.2.A1 msg 1.1.2.A2 


i2.1 


i2.2 


i2.3 ... 


1.1.2 


msg 1.1.2.B1 msg 1.1.2.B2 


iN.l 


iN.2 


iN3 ... 


1.1.2 


msg 1.1.2.M1 msg 1.1.2.M2 


il.l 


il.2 


il.3 ... 


X.Y.I 


msg X.Y.1.A1 msg X.Y1.A2 


i2.1 


i2.2 


i2.3 ... 


X.Y.I 


msg X.Y.1.B1 msg X.Y1.B2 


iN.l 


iN.2 


iN.3 ... 


X.Y.1 


msg X.Y.1.M1 msg X.Y.1.M2 


il.l 


il.2 


il.3 ... 


X.YZ 


msg X.Y.Z.A1 msg X.Y.Z.A2 


i2.1 


i2.2 


i2.3 ... 


X.YZ 


msg X.Y.Z.B1 msg X.Y.Z.B2 


iN.l 


iN.2 


iN.3 ... 


X.YZ 


msg X.Y.Z.M1 msg X.YZ.M2 



It should be appreciated that the training records used to 
train a neural network depend upon the particular logic 
desired to be encoded in the network. Moreover, it should be 
appreciated that the message disguising function of an agent 
may be implemented either via a neural network or with 
procedural decision making, and that separate neural net- 
works may be used for the decision making and message 
disguising functions. In addition, various additional func- 
tions for an agent may be incorporated into the same or 
different neural networks as for either the decision making 
or message disguising functions. Other modifications will be 
apparent to one skilled in the art. 

Exemplary Hardware/Software Environment 

A representative hardware environment suitable for the 
training and/or hosting of intelligent agents consistent with 
the invention is illustrated in FIG. 4, where a networked 
computer system 10 generally includes one or more com- 
puter systems, e.g., single -user computer systems 16, 18 and 
multi-user computer systems 20, 60, coupled through a 
network 15. Multi-user computer system 20 typically 
includes one or more servers 25 to which one or more 
single-user computers 22 may networked through a separate 
network 24. Similarly, multi-user computer system 20 typi- 
cally includes one or more servers 65 coupled to one or more 
single-user computer systems 62 through a network 64. 
Network 15 may represent any type of networked 
interconnection, including but not limited to local-area, 
wide-area, wireless, and public networks (e.g., the Internet). 

It is anticipated that agents consistent with the invention 
may originate in and be resident from time to time on any of 
the above-mentioned computer systems. One possible dis- 
tinction between the computer systems for the purposes of 
the invention may be whether each is a client or a remote 
system relative to a particular agent. For example, FIG. 5 
illustrates an embodiment of computer system 10 where 
multi-user computer system 20 is a client system, and 
multi-user computer system 60 is a remote system. 

A client system will hereinafter refer to a computer 
system that provides an agent a certain level of security from 
manipulation by other parties when the agent is resident on 
the system. The client system is also the computer system 



;5,178 

10 

from which management of the agent is typically handled. 
The agent typically but not necessarily will also originate 
from the client system. 
A remote system, on the other hand, will hereinafter refer 

5 to a computer system that is typically not capable of pro- 
viding a desired level of security for an agent, generally 
because the computer system is not under the control of the 
client. It is typically while resident on a remote system that 
an agent runs the greatest risk of being scanned or reverse 

10 compiled, or of having communications intercepted or 
monitored, by other parties. 

The various embodiments described herein have principal 
uses in electronic commerce applications, where agents are 
configured to negotiate commercial transactions, generally 

15 in the role of buying or selling agents. The agents may 
negotiate with other agents, other computer systems, or even 
other individuals. The agents may interact one-on-one, or 
may be capable of operating within a "market" of multiple 
agents, along the lines of a stock or commodity market. 

20 Computer systems having the ability to host agents for 
interaction therebetween include negotiating programs of 
varying sophistication and are hereinafter referred to as 
agent hosts. However, it should be appreciated that the 
invention applies equally to other applications of intelligent 

25 agents, and thus should not be limited specifically to com- 
mercial applications. 

FIG. 5 illustrates a mobile intelligent agent 100 which 
communicates with an agent manager 32 in client system 20. 

30 During negotiation with another party such as negotiating 
agent 95, mobile agent 100 is resident on remote system 60. 
It should be appreciated that remote system 60 may be the 
client for agent 95, or may also be considered to be remote 
relative to this agent as well. 

35 An exemplary functional design of networked computer 
system 10 for implementing the various embodiments of the 
invention is illustrated in FIG. 6. Server 25 of client system 
20 generally includes a central processing unit (CPU) 28 
coupled to a memory 30 and storage 40 over a bus 54. A 

40 local area network interface is provided at 52, and an 
interface to remote system 60 over external network 15 is 
provided through interface 50. Agent manager program 32 is 
resident in memory 30, as is an agent trainer program 34 
which trains agents. Storage 40 includes one or more trained 

45 agents 42 (of which may include agent 100, for example), 
which are computer programs or modules that may be 
retrieved and used locally within system 20, or dispatched to 
remote systems to execute and perform tasks on behalf of the 
client system. Storage 40 also includes an agent mission 

50 database 44 which may track agent operations and the 
relative success or failure thereof. Moreover, a training 
database 46 includes training data utilized by agent trainer 
program 34 to train agents, and translation tables 48 are 
utilized by agent trainer program 34 as well as by agent 

55 manager 32 to encode and decode messages to and from 
mobile agents, as will be discussed in greater detail below. 

Server 65 of remote system 60 also includes a CPU 68 
coupled to a memory 70, storage 80, external network 
connection 90 and local network connection 92 over a bus 

60 94. An agent host program 72 is resident in memory 70 to 
handle interactions between agents resident in the remote 
system. Typically, the agent host program is an asynchro- 
nous message/event driven environment that provides a 
common platform over which agent computer programs 

65 execute and interact, much like an operating system. The 
agent host is also capable of permitting messages to be sent 
between agents and their clients. Memory 70 also includes 
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a negotiating program 74 which operates as the "other party" it at block 140, typically issuing a response message back to 
in transactions with agent 100, which may be another agent, agent 100. Control of agent 100 returns to block 132 to 
a market or bulletin board application, or even an interface process the response message from party 95. 
program through which an individual interacts with agent Second, as illustrated by blocks 141 and 142, agent 100 
100. Storage 80 maintains a transaction history database 82 S may decide to send a message back to agent manager 32. 
which logs the transactions completed on the server. Consistent with the invention, this message is disguised in 
Servers 25, 65 may be, for example, AS/400 midrange block 141 in the manner disclosed herein, and then sent in 
computers from International Business Machines Corpora- block 142. Agent manager 32 then receives and interprets 
tion. However, it should be appreciated that the hardware the message at block 144, processes the message in block 
embodiments described herein are merely exemplary, and 10 146 and disguises and sends a response message back to 
that a multitude of other hardware platforms and configu- agent 100 in block 148. Upon receipt of the response 
rations may be used in the alternative. message, block 150 interprets the message and passes con- 
Moreover, while the invention has and hereinafter will be tro1 to block 132 to process the response message from agent 
described in the context of fully functioning computer manager 32. 

systems, those skilled in the art will appreciate that the 15 Third, as illustrated by block 152, agent 100 may decide 

various embodiments of the invention are capable of being to leave the remote system and return to its client system, 

distributed as a program product in a variety of forms, and e.g., after completion of a successful transaction or after 

that the invention applies equally regardless of the particular termination of an unsuccessful negotiation. The return of the 

type of signal bearing media used to actually carry out the agent is illustrated in block 154. 

distribution. Examples of signal bearing media include but 20 The illustrated program flow for agent 100 is an example 

are not limited to recordable type media such as floppy 0 f a semi-autonomous agent that has authority to negotiate 

disks, hard disk drives, and CD-ROM's, and transmission with another party with limits on the offer amount and the 

type media such as digital and analog communications links. number of iterations (offers made by the agent) that the agent 

^ . . W1 . , w ^. .. . . „, can undertake on its own. Agents with greater or lesser 

Decision Making and Message Disguising with 25 degrees Qf domain Pledge may also be used consistent 

n e gen gen ^ mvent i on p or example, a fully autonomous agent 

FIG. 7 illustrates an exemplary program flow illustrating may be delegated the authority to negotiate without any 

the interaction between an agent 100, agent manager 32 and input other than a desired transaction. In contrast, a fully 

another party, negotiating agent 95. Negotiations are gener- 3Q dependent agent may have little authority other than to act 

ally instituted by agent manager 32 by dispatching agent 100 as an intermediary by issuing offers and completing trans- 

to a remote system, as illustrated in block 130. It should be actions pursuant to specific instructions from a manager and 

appreciated that agent 100 may be dispatched with a desired reporting the results back to the manager, 

transaction or transactions which the client wishes to com- Various agents of this type are discussed further, for 

plete (including information such as desired quantity, 35 example, in U.S. Patent application Ser. Nos. 08/822,993 

description of goods/services to be sold/purchased, etc.), as and 08/826,107, respectively entitled "APPARATUS AND 

well as any other constraints placed upon the agent by the METHOD FOR OPTIMIZING THE PERFORMANCE OF 

manager (e.g., the number of negotiation iterations to COMPUTER TASKS USING MULTIPLE INTELLIGENT 

process, a maximum or minimum limit on the amount to AGENTS HAVING VARIED DEGREES OF DOMAIN 

offer, etc.). In the alternative, some or all of this information 4Q KNOWLEDGE*' and "APPARATUS AND METHOD FOR 

may be relayed to agent 100 at a later time by agent manager OPTIMIZING THE PERFORMANCE OF COMPUTER 

32. TASKS USING INTELLIGENT AGENT WITH MUL- 

Next, in block 132, agent 100 gathers and filters infer- TIPLE PROGRAM MODULES HAVING VARIED 
mation after it has been dispatched to the remote system. For DEGREES OF DOMAIN KNOWLEDGE", which have 
example, agent 100 may poll a bulletin board or market for 45 been incorporated by reference. As is also discussed in these 
outstanding offers, or may attempt to find and initiate applications, agent 100 may be one of several agents having 
negotiations with another party, e.g., another computer varying degrees of domain knowledge, or may have multiple 
system, another agent, or an individual interacting through a modules with varying degrees of domain knowledge, so that 
computer system. Agent 100 may also simply wait for the agent may be optimized for operation in different situ- 
incoming offers from other parties. Block 132 also performs 50 ations based upon an objective criteria (e.g., security 
the functions of processing messages from other parties and concerns). 

from the agent manager. The primary components in agent 100 for implementing 

Next, in response to input received by agent 100, a the program flow of FIG. 7 are illustrated by negotiation 

decision is made by agent 100 in block 134. It is in this block module or mechanism 200 in FIGS. Sa and 86. A mechanism 

that the negotiation strategy of agent 100 is implemented, 55 or module may be considered to include any function, 

whereby the agent determines, based upon the input it object, or block of program code configured to perform a 

receives, whether and how to proceed in negotiations with desired task or operation. 

another party. Also, supportive procedural processing is Module 200 is configured to utilize a selector such as a 

completed, such as incrementing internal counts, e.g., the message time stamp or other transmitted parameter, with a 

number of iterations (discussed below). 60 s i ng i e set of messages used to disguise various confidential 

Generally, one of three actions may be instituted in instructions and requests passed between the client and the 

response to block 134. First, as illustrated by block 136, agent. The client and agent in this embodiment transmit only 

agent 100 may decide to send a message to other party 95, one message at a time to represent a given instruction or 

e.g., indicating acceptance or rejection of an outstanding request, and some if not all of the messages have alternate 

offer, issuing an offer or counteroffer, terminating 65 meanings depending upon the value of the selector, 

negotiations, requesting that the other party wait, etc. The However, it should be appreciated that any of the above - 

other party receives the message at block 138 and processes described modifications and variations in terms of possible 
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selectors and manners of disguising messages may be used as a selector. For example, if a time stamp or other trans- 

in the alternative. mitted parameter is used, such information would be input 

Module 200 is configured to receive the following inputs: t0 filter 204 On the other hand, if a non-transmitted param- 

other party's last price ctcr is uscd > c % > tf selector is changed every n 

, 5 transmissions, then filter 204 may be configured as a logic 

other party s current price element such as a counter which is incremented every n 

agent's last public offer transmission cycles. Because it may be possible for selector 

product characteristics values to be observed as they are being gathered, any 

instruction from manager: amount of superfluous information may also be gathered to 

increase in offer authorized 10 assist in deception. 

increase in iterations authorized The last and current prices offered by the other party to the 

increase in offer not authorized negotiation are stored in a pair of registers 220, 222 and 

increase in iterations not authorized conditioned by filters 206 and 208, which in this embodi- 

last message sent back to manager ment m implemented using neural networks. In addition, 

- . " 15 the last offer generated by the agent is stored in a register 224 

T C j!v j i "%/\t\ ' n j A . and conditioned by filter 210, also implemented as a neural 

In addition, module 200 is configured to generate the netWQrk Fnters 206 _ 2Q8 alsQ feceive ^ decoded 

following outputs. inpm Regislers 2 20 and 222 are maintained by the infor- 

public price offer mat i on gathering block 132 (FIG. 7) based upon the prices 

message to other party 20 received from the other party. Register 224 is maintained by 

make offer a price offer generator filter 228 (FIG. 8b, as discussed 

withdraw below). 

accept In addition, each filter 206-210 outputs an identification 

reject (ID) signal, as well as three data signals designated value 1, 

counteroffer 25 value 2 and value 3. The ID signal output by each filter 

please wait operates similar to a selector to indicate which of the n (here 

finished three) data signals includes the conditioned representation of 

message to manager the corresponding register's contents. The other two data 

probable acceptable alternative, do you accept signals operate are unused and act as decoys to deter reverse 

iterations exceeded, recommend continue 30 compilation of the decision logic of the module. The ID 

iterations exceeded, recommend withdrawal signal may be a function of the decoded selector input, or 

recommend immediate withdrawal mav be independent thereof. In the alternative, a single value 

dummy transmission to motivate negotiation signal may be connected between each filter 206-210 and 

request approval to increase offer primary network 202 if detection of these conditioned 

Two variables, the number of iterations and the offer 35 signals is not a concern, 

increment (the current authorized negotiation margin for the An instruction decode network filter 212 receives binary 

agent), are also maintained in module 200 for feedback messages from the client, as well as the decoded selector 

purposes, but are generally not accessed by external sources. signal to interpret the messages. A single instruction signal 

Moreover, for training purposes, additional information & output from filter 212. The instruction signal varies for any 

may also be used in the generation of suitable training 40 S iven message depending upon the value of the decoded 

records, although the information is not directly input to the selector signal. 

module. Such information includes: An optional basic requirements network filter 214, which 

desired price and features » P rimaril y for a buying agent, receives one or more 

, P . ... , . , product characteristics related to the features of the goods/ 

agent autonomy price range (range of paces within which 45 ^ tktcd for red t0 the features 

agent ,s authorized to negotiate autonomously) desifed by ^ diem In response> fiUer n4 a malch 

manager approval price range (range of prices within s j gna i w hich indicates the degree in which the products 

which agent requires approval from manager) being negotiated for match what the client is actually 

acceptable iterations allowed without approval looking for. 

Module 200 includes a primary neural network 202 in 50 The product characteristics may include basic require- 

which the decision logic for decision making (including ments that must be met to complete the transaction, as well 

negotiation strategy), message disguising, and other tunc- as additional features that may not be required but which 

tions is implemented. In addition, as shown in FIG. Sa, a may make the products more desirable to the client. For 

number of filters 204-214 are utilized at the input side of example, for a VCR, a client may require that it have four 

primary network 202 to condition the inputs to the network, 55 heads, but the client may be willing to pay more for a hi-fi 

since neural networks typically operate on weights in the stereo model if one is available. The match signal for a hi-fi 

range of -1 to +1, or 0 to +1. Filters 204-214 may be model being negotiated for may be weighted more strongly 

implemented using procedural logic, or alternatively, may be than one without hi-fi, and as a consequence, the agent may 

implemented using separate neural networks to increase be configured to negotiate more strongly for the hi-fi model 

security. 60 in response to this signal. 

A selector decode filter 204 is implemented in this Two additional registers 216, 218 are maintained by 

embodiment as a neural network which receives the desired primary network 202 and are fed back as input thereto. An 

selector information and outputs a decoded selector signal, offer increment register 216 represents the current negotia- 

designated sel. The decoded selector signal is provided to tion margin for the agent, as modified by the agent manager 

primary network 202, as well as to a number of the filters in 65 through instructions to the agent. The negotiation margin 

module 200, as detailed below. The configuration of filter represents in filtered form that amount over which (for a 

204 will vary depending upon the type of information used buying agent) or under which (for a selling agent) the agent 
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may complete a transaction outside of the desired price for 
the transaction. 

An iteration register 218 maintains in filtered form the 
number of cycles in the current negotiation, where one cycle 
typically represents a transmission from the agent to another 
party or to the agent manager. The agent is typically trained 
with a number of cycles for which the agent is authorized to 
negotiate without approval from the manager, and this 
number may be varied or overridden in response to an 
instruction from the agent manager. 

Primary network 202 also receives as feedback a price 
offer delta signal related to the change in the agent's last and 
current offers, and a send message signal and a undisguised 
message signal related to the last message sent from the 
agent to the client. Each of these signals are output from 
network 202 (FIG. &b). 

As shown in FIG. 8b, primary network 202 outputs a 
number of other signals in response to the inputs shown in 
FIG. 8a. A set of filters 226-234 condition these output 
signals from neural network levels to levels that are more 
useful external to the primary network. 

A negotiation message creator filter 226, which is imple- 
mented in this embodiment as procedural logic, receives an 
output signal from network 202 and any value from the price 
offer generator 228 and outputs a message to the other party. 
The output message may include a number of possible 
messages, such as accept, reject, counteroffer, wait request, 
and negotiations finished, among others. The format of the 
message may follow a predetermined protocol that is under- 
standable to the other party. 

A price offer generator filter 228, which is also imple- 
mented in procedural logic in this embodiment, receives a 
price offer delta parameter and the value previously stored in 
my last offer block 224 and outputs therefrom the current 
price offer which is stored in register 224. The price offer 
delta parameter is also fed back to primary network 202 as 
described above. 

The current offer may be supplied in conjunction with the 
message to the other party provided by filter 226. In 
addition, the current offer may also operate as a public offer 
which can be polled by other agents wishing to engage in 
negotiations with agent 100. The current offer may also be 
output to a market or bulletin board set up on an agent host 
to solicit negotiations with other parties. 

An adjust iteration filter 230, which in this embodiment is 
implemented with procedural logic, receives an iteration 
increment signal to increment register 218 in response 
thereto. Filter 230 also receives a reset signal to reset register 
218 in response to an increase in iterations authorized 
instruction. 

In addition, an increment processor filter 232, imple- 
mented in this embodiment with procedural logic, receives 
a change increment signal and an increment value signal. In 
response to a suitable change increment signal, the incre- 
ment value represented by the increment value signal is 
output in filtered form and stored in register 216. 

A message creator filter 234, which is implemented as 
procedural logic in this embodiment, is used to output 
disguised messages to the agent's client in the manner 
discussed above. Filter 234 receives a send message signal 
as well as a signal for the disguised message to send. As 
discussed above, the undisguised message is typically one of 
several messages such as: "probable acceptable alternative, 
do you accept", "iterations exceeded, recommend continue", 
"iterations exceeded, recommend withdrawal", "recom- 
mend immediate withdrawal", a dummy transmission to 
motivate negotiation, and "request approval to increase 
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offer", among others. The send message signal initiates the 
transmission of a disguised message for the given message 
output by primary network 202. 

The decoded selector signal sel is also received as input 

5 to block 234 as well as unfiltered selector values for inclu- 
sion in the message as needed. Other value signals, such as 
the current and/or last prices offered by the other party and 
stored in registers 220, 222, and the product characteristics 
supplied to filter 214, may also be received as input for 

10 incorporation in the message to the manager. 

In response to these inputs, filter 234 outputs a message 
to the agent manager. The message may be text, binary or 
other data formats which are recognizable by the agent 
manager. For example, the message may be a textual mes- 

15 sage representative of one of the undisguised messages, but 
with the selector indicating another message than that rep- 
resented by the undisguised message (e.g., with a certain 
selector, "recommend immediate withdrawal" may be inter- 
preted by the agent manager to mean "probable acceptable 

20 alternative, do you accept"). 

It should be appreciated that in the illustrated embodiment 
of module 200, the decision making and message disguising 
functions of agent 100, which may be conceptually consid- 
ered to be performed by separate decision making and 

25 message disguising modules or mechanisms (e.g., as illus- 
trated by blocks 134 and 141 in FIG. 7), are both principally 
implemented in primary network 202. It should also be 
appreciated that the functions may be separated into differ- 
ent neural networks in the alternative. Moreover, it should be 

30 appreciated that primary network 202 may also be imple- 
mented via an interconnected network of separate neural 
networks. 

As a component of its decision making function, primary 
network 202 may implement a number of negotiation strat- 

35 egies consistent with the invention. For example, U.S . Patent 
application Ser. No. 08/821,935, entitled "INTELLIGENT 
AGENT WITH NEGOTIATION CAPABILITY AND 
METHOD OF NEGOTIATION THEREWITH", which has 
been incorporated by reference, discloses a negotiation 

40 strategy which relies on the previous and current offers from 
the agent as well as the previous and current prices offered 
by the other party. A number of additional negotiation 
features suitable for use by primary network 202 are also 
implemented in the aforementioned application, including 

45 dynamic value determination, disguising negotiation strat- 
egy by randomizing an agent's behavior, and limiting unpro- 
ductive negotiations by constraining an agent's behavior, 
among others. Other negotiation strategies and features may 
also be used consistent with the invention. 

50 A wide variety of known neural network designs may be 
used for primary neural network 202 and any of the illus- 
trated network filters consistent with the invention. For 
example, one suitable neural network design is a back 
propagation neural network known in the art. Other neural 

55 network designs, including a radial basis function network, 
among others, may also be used in the alternative. A suitable 
development environment for performing the development 
and training of such neural networks is the IBM Neural 
Network Utility available from International Business 

60 Machines Corporation, among others. 

Training for the networks in module 200 is performed via 
the Supervised training process for neural networks, with the 
exception of the additional input provided by the decoded 
selector signal. Each neural network/filter in module 200 

65 may be trained separately, although the training process is 
significantly simplified if the entire module 200 is trained at 
once using combined training records. 
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For example, one suitable process for training module 200 
is illustrated by network training routine 300 in FIG. 9. 
Generally, the program flow includes three nested for-next 
loops. The first for-next loop, illustrated at block 302, cycles 
through each possible value of the selectors). For each s 
value, a second for-next loop, illustrated at block 302, cycles 
through each training record. 

For each training record, the record is obtained in block 
306. A suitable training record may have the general format 
illustrated in Table II above. io 

Next, a third for-next loop, illustrated at block 308, cycles 
through each output in the record, and at block 310, gener- 
ates a trained output value using a transform function that is 
based upon the current value of the selector, and the desired 
output. The trained output is retrieved using a transform 15 
table, e.g., as illustrated by Table I above, where a disguised 
message is selected from a set of messages to represent a 
desired output. 

Once suitable disguised (trained) outputs have been gen- 
erated for a training record, block 308 passes control to 20 
block 312 to train the neural network using the training 
record, current selector and the disguised outputs. 

After the training record is used to train module 200, 
control then returns to block 304 to process the next training 
record. Program flow continues until module 200 has beeo 25 
trained with each training record, as modified for each value 
of the selectors). 

It should be appreciated that a primary benefit of routine 
300 is that training is simplified since the need to generate 
separate training records for each selector value is elimi- 30 
nated. In the alternative, however, individual training 
records for each value of the selector may be generated, e.g., 
in the forms illustrated in Tables III-V above. 

It is anticipated that module 200 of agent 100 may be 
trained by an agent manager to handle all possible situations, 35 
including all of the types of goods/services, etc. to be 
purchased or sold by the agent, whereby the agent manager 
merely dispatches the agent when negotiations are desired. 
In the alternative, the agent manager may train an agent with 
only the information related to a particular desired transac- 40 
tion immediately prior to dispatching the agent. This latter 
process may require additional time to dispatch ao agent 
once a transaction is desired, however, the size and com- 
plexity of the agent may be significantly reduced if the agent 
is more narrowly focused. 45 

It should be appreciated that beyond decision making and 
disguising messages, other functionality may be required for 
the autonomous operation of agent 100, and that such 
additional functionality may be implemented via procedural 
logic and/or neural networks, whether incorporated within 50 
negotiation module 200 or in a separate program module. 
For example, functions such as initialization, maintenance, 
finding other agents or markets to interact with, etc. may also 
be utilized. However, as these functions relate more to the 
basic operation of an agent, which is in general known in the 55 
art, these functions will not be discussed in any greater detail 
herein. 

Other modifications will be apparent to one skilled in the 
art. Therefore, the invention lies solely in the claims here- 
inafter appended. 60 

What is claimed is: 

1. A method of communicating between an intelligent 
agent computer program and a client computer process, 
comprising the steps of: 

(a) selecting a message from a plurality of messages based 65 
upon a selector and information to be transmitted 
between the intelligent agent and the client computer 



18 

process to disguise the information from discovery by 
a third party; and 
(b) transmitting the selected message between the intel- 
ligent agent and the client computer process. 

2. The method of claim 1, wherein the selecting and 
transmitting steps are performed in the intelligent agent, and 
wherein the method further comprises the step of determin- 
ing the information to be transmitted using a neural network 
into which has been programmed a decision logic for the 
intelligent agent. 

3. The method of claim 2, wherein the selecting step 
includes the step of selecting the message using a neural 
network into which has been programmed a transform table 
for matching a message with the information to be trans- 
mitted. 

4. The method of claim 3, wherein the intelligent agent is 
configured to conduct negotiations in an electronic com- 
merce application, wherein the decision logic for the intel- 
ligent agent includes a negotiation strategy, and wherein the 
information to be transmitted by the intelligent agent 
includes at least one of the group consisting of probable 
acceptable alternative do you accept, iterations exceeded 
recommend continue, iterations exceeded recommend 
withdrawal, recommend immediate withdrawal, request 
approval to increase offer, and a dummy transmission to 
motivate negotiation. 

5. The method of claim 1, wherein the selector includes a 
predetermined parameter known to both of the intelligent 
agent and the client computer process. 

6. The method of claim 5, wherein the selector is changed 
after a predetermined number of transmissions between the 
intelligent agent and the client computer process. 

7. The method of claim 1, wherein the selector is trans- 
mitted between the intelligent agent and the client computer 
process. 

8. The method of claim 1, wherein the selector is derived 
from an existing parameter having another purpose. 

9. The method of claim 8, wherein the selector is derived 
from a time stamp appended to the selected message trans- 
mitted between the intelligent agent and the client computer 
process. 

10. The method of claim 1, wherein each of the plurality 
of messages has a plurality of alternate meanings which are 
selected based upon the selector. 

11. The method of claim 1, wherein the selecting step 
includes the step of selecting at least one additional message 
from the plurality of messages, and wherein the transmitting 
step includes the step of additionally transmitting the addi- 
tional message between the intelligent agent and the client 
computer process; 

whereby the selector controls which of the transmitted 
messages includes the information to be transmitted. 

12. The method of claim 1, wherein the selecting step 
includes the step of selecting each message from the plu- 
rality of messages with the exception of an omitted message 
corresponding to the information to be transmitted, and 
wherein the transmitting step includes the step of transmit- 
ting every message in the plurality of messages except for 
the omitted message. 

13. The method of claim 1, wherein the selecting step 
includes the step of determining the message to select using 
a transform table indexed by the selector and the information 
to be transmitted. 

14. The method of claim 1, wherein the message trans- 
mitted in the transmitting step is unscrambled. 

15. A method of communicating with an intelligent agent 
computer program, the method comprising the steps of: 
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(a) processing with a neural network an input received 
from an external source and thereby generating an 
output therefrom; 

(b) disguising the output in an output message selected 
from a plurality of messages based upon the output and 5 
a selector; and 

(c) transmitting the output message. 

16. The method of claim 15, wherein the disguising step 
is performed using a neural network. 

17. The method of claim 16, wherein the processing and 10 
disguising steps are performed using the same neural net- 
work. 

18. A method of communicating between an intelligent 
agent computer program and a client computer process, 
comprising the steps of: 15 

(a) receiving a disguised message transmitted between the 
intelligent agent and the client computer process, the 
disguised message selected from a plurality of 
messages, each of which is related to predetermined 2Q 
information based upon a selector; 

(b) determining the selector; and 

(c) interpreting the disguised message using the selector 
to determine the predetermined information transmitted 

in the disguised message. 25 

19. A program product comprising: 

(a) a program configured to perform a method of com- 
municating between an intelligent agent computer pro- 
gram and a client computer process, the method com- 
prising the steps of: 30 

(1) selecting a message from a plurality of messages 
based upon a selector and information to be trans- 
mitted between the intelligent agent and the client 
computer process to disguise the information from 
discovery by a third party; and 35 

(2) transmitting the selected message between the intel- 
ligent agent and the client computer process; and 

(b) a signal bearing media bearing the program. 

20. The program product of claim 19, wherein the signal 
bearing media is transmission type media. 

21. The program product of claim 19, wherein the signal 
bearing media is recordable media. 

22. An apparatus for communicating with one of an 
intelligent agent computer program and a client computer 
process, the apparatus comprising: 

(a) a decision logic mechanism, configured to receive an 
input from an external source and generate therefrom 
an output; and 

(b) a message disguising mechanism, configured to 50 
receive the output of the decision logic mechanism and 
output a selected message from a plurality of messages 

as a disguised message in response to a selector and the 
output of the decision logic mechanism. 

23. The apparatus of claim 22, wherein the decision logic 55 
mechanism is incorporated in an intelligent agent computer 
program, and wherein the decision logic mechanism 
includes a neural network into which has been programmed 

a decision logic for the intelligent agent. 

24. The apparatus of claim 23, wherein the message 60 
disguising mechanism includes a neural network into which 
has been programmed a transform table for matching a 
message with the information to be transmitted. 
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25. The apparatus of claim 24, wherein the decision logic 
mechanism and the message disguising mechanism are 
incorporated into the same neural network. 

26. The apparatus of claim 23, wherein the decision logic 
mechanism further comprises a plurality of neural network 
filters for conditioning inputs and outputs to and from the 
neural network. 

27. The apparatus of claim 23, wherein the intelligent 
agent is configured to conduct negotiations in an electronic 
commerce application, and wherein the neural network is 
programmed with a negotiation strategy for the intelligent 
agent. 

28. The apparatus of claim 22, wherein the selector 
includes a predetermined parameter known to both of the 
intelligent agent and the client computer process. 

29. The apparatus of claim 22, wherein the selector is 
transmitted between the intelligent agent and the client 
computer process. 

30. The apparatus of claim 22, wherein the selector is 
derived from an existing parameter having another purpose. 

31. A method of communicating between an intelligent 
agent computer program and a client computer process, 
comprising the steps of: 

(a) determining information to be transmitted using a 
neural network into which has been programmed a 
decision logic for the intelligent agent; 

(b) selecting a message from a plurality of messages 
based upon a selector and the information to be trans- 
mitted between the intelligent agent and the client 
computer process; and 

(c) transmitting the selected message between the intel- 
ligent agent and the client computer process; wherein 
the selecting and transmitting steps are performed in 
the intelligent agent. 

32. A method of communicating between an intelligent 
agent computer program and a client computer process, 
comprising the steps of: 

(a) selecting a message from a plurality of messages based 
upon a selector and information to be transmitted 
between the intelligent agent and the client computer 
process, wherein each of the plurality of messages has 
a plurality of alternate meanings which are selected 
based upon the selector; and 

(b) transmitting the selected message between the intel- 
ligent agent and the client computer process. 

33. An apparatus for communicating with one of an 
intelligent agent computer program and a client computer 
process, the apparatus comprising: 

(a) a decision logic mechanism incorporated in an intel- 
ligent agent computer program, the decision logic 
mechanism configured to receive an input from an 
external source and generate therefrom an output, and 
the decision logic mechanism including a neural net- 
work into which has been programmed a decision logic 
for the intelligent agent computer program; and 

(b) a message disguising mechanism, configured to 
receive the output of the decision logic mechanism and 
output one of a plurality of messages as a disguised 
message in response to a selector and the output of the 
decision logic mechanism. 
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